Oblique Linear Tree

نویسنده

  • João Gama
چکیده

In this paper we present system Ltree for proposicional supervised learning. Ltree is able to define decision surfaces both orthogonal and oblique to the axes defined by the attributes of the input space. This is done combining a decision tree with a linear discriminant by means of constructive induction. At each decision node Ltree defines a new instance space by insertion of new attributes that are projections of the examples that fall at this node over the hyperplanes given by a linear discriminant function. This new instance space is propagated down through the tree. Tests based on those new attributes are oblique with respect to the original input space. Ltree is a probabilistic tree in the sense that it outputs a class probability distribution for each query example. The class probability distribution is computed at learning time, taking into account the different class distributions on the path from the root to the actual node. We have carried out experiments on sixteen benchmark datasets and compared our system with other well known decision tree systems (orthogonal and oblique) like C4.5, Oc1 and LMDT. On these datasets we have observed that our system has advantages in what concerns accuracy and tree size at statistically significant

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Non-Linear Decision Trees - NDT

Most decision tree algorithms focus on uni variate i e axis parallel tests at each inter nal node of a tree Oblique decision trees use multivariate linear tests at each non leaf node This paper reports a novel approach to the construction of non linear decision trees The crux of this method consists of the gen eration of new features and the augmenta tion of the primitive features with these ne...

متن کامل

Probabilistic Linear Tree

DNF systems divide the input space into decision surfaces, defined by conjunctions of conditions based on attribute-value pairs. This means that the decision surfaces are orthogonal to the axis of the tested attribute and parallel to all the other axes. In this paper, we present the system Ltree, that is able to define decision surfaces both orthogonal and oblique to the axes defined by the att...

متن کامل

CO2 Forest: Improved Random Forest by Continuous Optimization of Oblique Splits

We propose a novel algorithm for optimizing multivariate linear threshold functions as split functions of decision trees to create improved Random Forest classifiers. Standard tree induction methods resort to sampling and exhaustive search to find good univariate split functions. In contrast, our method computes a linear combination of the features at each node, and optimizes the parameters of ...

متن کامل

Induction of LDA Oblique Decision Rules

This paper presents a new algorithm of decision rules with oblique conditions induction. It bases on the Fisher’s Linear Discriminant Analysis as a tool of finding an initial classes separation. This technique has a good ability of oblique dependencies generalisation what reduces the number of decision rules and their complexities. Keywords—classification, machine learning, Linear Discriminant ...

متن کامل

New algorithms for learning and pruning oblique decision trees

In this paper, we present methods for learning and pruning oblique decision trees. We propose a new function for evaluating different split rules at each node while growing the decision tree. Unlike the other evaluation functions currently used in literature (which are all based on some notion of purity of a node), this new evaluation function is based on the concept of degree of linear separab...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997